ED 129 423 



DOCDMENT RESDHE 



PS 008 82U 



TITLE 

INSTITUTION 
SPONS AGENCY 



REPORT NO 
PUB DATE 
GRANT 
NOTE 



A School and Home-Based Bilingual Education Model. 
End-of-Year Evaluation Report, 1975-76 (First-Year 
Evaluation Study) . 

Askins (B.E.) and Associates, Lubbock, Tex. ; Clovis 

Public Schools, N. Mex. ' 

Bureau of Elementary and Secondary Education 

(DHEH/OE) , Washington, D. C. Div. of Bilingual 

Education. 

i*03-AH-5C157 

Jun 76 

OEG-GOO-75-07036 

36p.; For related documents, see ED 081 (X75, ED 103 
108, and ED 116 812 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



?5F-$0.83 HC-$2.06 Plus Postage. 

♦Bilingual Education; Demonstration Programs; English 
(Second Language) ; Home Visits; *Intervention; 
Language Development; Mexican Americans; Parent 
Participation ; Personality Development ; Personnel 
Evaluation; Preschool Children; *Preschool Education; 
♦Program Descriptions; *Program Evaluation; 
Psychomotor Skills; School Readiness Tests; Self 
Concept; Social Development; Spanish Speaking 
Clovis New Mexico Public Schools; Portales New Mexico 
Public Schools; Responsive Environment Early 
Education Program; *School and Home Based Bilingual 
Education Model 



. ABSTRACT 

This report describes an external evaluation study of 
a project designed to develop, over a 5-year period, a model 
bilingual program from nursery school throiigh grade 6. Innovative and 
tested instructional bilingual-bicultural components (language, 
perceptual^ healthj motor and cognitive) are being implemented in an 
attempt to reach children with limited English speaking ability from 
low income families. The primary focus of this evaluation was on the 
nursery school unit serving 3- and U-year-old children at two sites. 
Evaluation of the instructional activities was based on a pretest and 
posttest design using standardized tests measuring language 
development in Spanish and English, school readiness, and 
self^concept and personality development. Staff development, parental 
involvement and materials development components were subjectively 
evaluated. Major findings included: (1) nursery school children made 
significant gains in language development (Spanish and English) , 
school readiness, and motor ability, and showed growth in 
self-concept and personal development; (2) students in grades K-2 
made significant gains in language development in Spanish and English 
and school readiness; (3) instructional, staff development and 
materials development components were effective, but the parent 
involvement component needs to be strengthened. (Author/MS) 



Documents acquired by ERIC include many informal unpublished materials not available from other sources. ERIC makes every 
effort to obtain the best copy available. Nevertheless, items of marginal reproducibility are often encountered and this affects the 
quality of the microfiche and hardcopy reproductions ERIC makes available via the ERIC Document Reproduction Service (EDRS). 
EDRS is not responsible for the quality of the original document. Reproductions supplied by EDRS are the best that can be made from 
— =ginal. 



us OEPARTMENT OF HEALTH. 
EDUCATION IWELFARE 
NATIONAL INSTITUTE OF 
EDUCATION 

THIS DOCUMENT HAS BEEN RfP«0; 
DUCED EXACTLY AS RECEIVED FROM 
THE PERSDN OR ORGANIZATION ORIGIN- 
ATtNOn POINTS DF VIEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRE- 
SENT DFFlC I AL NATIONAL INSTITUTE OF 
EDUCATION POSITION OR POLICY 



END-OF-YEAR EVALUATION REPORT 

1975-76 
FIRST-YEAR EVALUATION STUDY 



A SCHOOL AND HOME-BASED BILINGUAL EDUCATION MODEL 



Nursery School - Grade 6 

Municipal Schools of Clovis and Portales, New Mexico 



Funded by: 

ESEA, Title VII Bilingual Education Project 
Bureau of Elementary and Secondary Education 
U.S. Office of Education 
Grant Number GOO-75-07036 
Project Number 403-AH-50i57 

Under Contract With: 

Clovis Municipal Schools 

800 Pile Street 

Clovis, New Mexico 88101 



Prepared by: 

B. E. Askins & Associates 
Box 4234, Texas Tech Station 
Lubbock, Texas 79409 



June, 1976 



CLOVIS AND PORTALES MUNICIPAL SCHOOLS 
Board of Education - Clovis 



Dr. Jacob Moberly, President 



Mr. Harry Eastman 
Mr. Wilbur Johnson 



Mr. Charles Guthals 
Mr. Billy Neal Williams 



Dr. L. W. Byous, Superintendent of Schools 

Mr. Davenport Beasley, Assistant Superintendent 

Board of Education - Portales 

Mr. Frank Barnett, President 



Mr. Lloyd Wilhoit 
Mr. Melvin Littlejohn 



Mr. Carlos Paiz 

Mr. Curtis Breshears 



Mr. L. C. Cozzens, Superintendent of Schools 
Mr. George Hughes, Assistant Superintendent 

Members of the Professional Advisory Board 



Dr. Gilbert Delgado, Dean 
Graduate School 
Gallaudet College 
Washington, D. C. 

Mr. Henry Pascual , Director 
Bil ingual-Bicultural 

Communicative Arts Unit 
State Department of Education 
Santa Fe, New Mexico 



Mr. Oralie McAfee 
Early Childhood 
Metropolitan State College 
Denver, Colorado 

Mr. Harry Wugalter 

Chief, Publ ic SchooT Finance 

Division 
Secretary for Education 
State Capitol Building 
Santa Fe, New Mexico 



Faculty/Staff 

Mrs. Gay Herman, Director 
Mrs. Paz Martinez, Coordinator 
Mrs. Julia Robertson, Secretary 



Teacher: 
Aides: 

Custodian: 



Clovis Site 

Mrs. Ruth Burns 

Mrs. Sally Romero 
Mrs. Clara Gomez 
Mrs. Clara Gonzales 



Portales Site 

Miss Constance Nash 
Mrs. Donna Fowler 



Mrs. Patsy Encinias Mr. Joe Daniels 

EVALUATION TEAM MEMBERS 

Dr. Billy E. Askins, Coordinator of Evaluation 
Dr. Joe D. Cornett, Research Associate 
Dr. Len Ainsworth, Consultant 

Dr. Ralph Carter, Test Specialist 

Mrs. Frankie Cook, Secretary/Administrative Assistant 



FOREWORD 



The following end-of-year evaluation report describes the effect 
of A School and Home-Based Bilingual Education Model during 1975-76. 
This evaluation study was conducted by an independent consultant and 
service organization with its direction primarily through various 
faculty members of the College of Education, Texas Tech University. 
This report is submitted in accordance with the approved Evaluation 
Proposal dated March 7, 1975 and the Educational Evaluation Agree- 
ment dated August 20, 1975. 

The evaluation team recognizes and hereby expresses appreciation 
to the project director, faculty, and staff of the program for their 
excellent cooperation during the evaluation process, especially during 
the periods of testing the young children. 

The invaluable assistance of the various professional and para- 
professional personnel on the evaluation team is also acknowledged 
and appreciated. 




Billy E\ Askins, Ed.D. 
Evaluation Coordinator 
June, 1976 
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SECTION I 



INTRODUCTION 



This report describes an external evaluation study of A School and 
Home-Based Bilingual Education Model during 1975-76, This model program' 
is a cooperative effort among the Clovis Municipal Schools (Clovis, New 
Mexico), Portales Municipal Schools (Portales, New Mexico), and the U.S. 
Office of Education (ESEA, Title VII), 

This evaluation study was conducted by B, E, Askins and Associates 
which is an independent consultant and service organization with its 
direction through various faculty members of the College of Education, 
Texas Tech University. 

The focus of the external evaluation study during 1975-76 was mainly 
on the nursery school unit of the program which serves 3- and 4-year-old 
children at the two sites in Clovis and Portales. 



Purpose of Program 

The purpose of this program was to develop for the two school dis- 
tricts, over a five year period, a model bilingual program from nursery 
school (beginning at age 3) through grade six. The program will imple- 
ment innovative and tested instructional bil ingual-bicul tural components 
(language development, perceptual, health, motor, and cognitive) to reach 
children with limited English speaking ability from low income families. 



Area Served and Locale of Program 

The area served by this program is the total attendance are served 
by both of the cooperating school districts: Clovis Municipal Schools, 
Clovis, New Mexico and Portales Municipal Schools, Portales, New Mexico. 

The nursery school unit operates at two different sites about twenty 
miles apart. The site location at Clovis is 312 Merriwether Street, and 
the site location at Portales is Lindsay Elementary School, 1216 West Ivy, 
The location of each of the two sites is in the section of town where 
there is a high concentration of the target group children. 

Target Children 

As concerns the nursery school unit, the target group children are 
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3- and 4-vear-old children at Clovis and Portales (approximately 40 at 
each site). The kindergarten unit serves 5-year-old children (approxi- 
mately 40 at each site). Also, target children include certain sections 
of grades 1-2 in Clovis and Portales. 



The number of children enrolled in the various levels of the pro- . 
gram as of October 1, 1975 were as follows: 

Nursery School Unit ^ ^ 

Clovis Site . There were 40 students (21 girls and 19 boys) enrolled. 

There were 16 second year students and 24 children started the program 
this year. 



Portales Site . There were 37 students (16 girls and 21 boys) enrol- 
led. There were 4 second year students and 33 children started the 
program this year. 



There were 37 kindergarden students at Clovis, and 41 at Portales. 
There were 46 first grade students at Clovis and 35 at Portales. 
There were 44 second grade students at Clovis and 44 at Portales. 



Number of Participants 



K - 2 
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SECTION II 
DESCRIPTION OF THE PROGRAM 



This program has a unique advantage and opportunity in that it can 
be viewed as an out-growth or as a satellite of an existing most success- 
ful early childhood program. This parent program is an early educational 
intervention program referred to as the Responsive Environment Early 
Education Program - REEEP (formerly the Responsive Environment Program 
for Spanish American Children - REPSAC)*, This program, also located in 
Clovis, New Mexico, fs designed to serve as an effective early educational 
intervention for 3-, 4-, and 5-year-old "high risk" children (4, 5, 6, and 
7). Such children are considered "high risk" as a result of their low 
birth weight (less than 5k pounds) and considered disadvantaged (low in- 
come of family plus other factors which constitute this condition). With 
the exception of the criteria used to select students to enter each program, 
the operation of the two programs are identical. Thus, the REEEP program 
provides a base for this program in terms of curriculum development and 
training of faculty/staff. 



Major Goals and Objectives 

Major Goals 

The major goals of this program are as follows: 

1. To provide children with limited English-speaking ability 
with a bilingual early childhood component to assist 
students to achieve educationally on a par with other 
children in their school and community. 

2. To create through a program of inservice training - 
awareness, acceptance, and knowledge of children's rights 
from teachers, administrators and the public in general. 

3. To develop and strengthen positive attitudes and respect 
for Mexican-American children and parents. 



*REEEP is funded by the New Mexico State Department of Education 
(ESEA, Title III), and the outreach activities of the program are funded 
by the Handicapped Children's Early Education Program, Bureau of Education 
for the Handicapped, U.S. Office of Education. 
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4. To enhance the richness and values of the two dominant 
languages of New Mexico and its three cultures so that 
future generations may possess unity of spirit. 

5. To meet the individual needs of children so that there 
is no need for various categories and labels such as 
educable mentally retarded, emotionally disturbed and 
learning disabilities which continue to keep Mexican- 
American children from achieving their potential. 

First Year Objectives 

To achieve these major goals, a set of 5 year objectives were devel- 
oped. The first year objectives included: 

1. To conduct needs assessment to identify schools who have children 
of limited English-speaking proficiency. 

2. To select two bilingual teachers for the grade two units in 
Portal es and Clovis; and two bilingual specialists - one per 
district for supervision, demonstration and parent training 
purposes. 

3. To select a Parent-Community Advisory group, 

4. To plan and implement a preservice program through Clovis and 
Portales schools and Eastern New Mexico University. 

5. To develop strategies and a long range plan for a degree orient- 
ed inservice training program. 

6. To develop cognitive skills. 

7. To develop in children a positive self concept. 

8. To increase sensory and perceptual acuity. 

9. To further develop psychomotor abilities. 

10. To improve language skills In both English and Spanish. 

11. To determine the most appropriate bilingual instructional method- 
ologies, materials and practices in all subject matter areas. 

12. To implement proven bilingual education in all subject matter 
areas, and show improvement in all areas. 
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13. To directly involve staff members in the 1975-76 operation who 
win be working in the vertical extension of the program In 
succeeding years. 

14. To expand the Home Tutor/Home Education to parents of children 
In the project. 

15. To establish a closer relationship between the home and school. 

16. To disseminate results of the project. 



Program Components and Objectives of the Nursery School 

The previously stated goals and objectives give direction to the 
organization and administration of various elements of the program com- 
monly referred to as program components which are: instructional; parental 
involvement; staff development; and materials development. 

Instructional Component 

This component is obviously considered the heart of the program be- 
cause this is where the teaching-learning activities take place. The 
majority of the instructional processes within this component are selected 
and conducted as patterned from the REEEP (REPSAC) project. 

,Each site has an enrollment of approximately 40 children. The stu- 
dents are divided into two groups of 20 each. "One group attends the morn- 
ing session from 8:30 to noon, and the other group attends the afternoon 
session from noon until 3:15 p.m. A portion of each session is spent in 
structured, directed-learning activities using materials which include the 
Piaget materials, Peabody Language Kits, Project LIFE, and the Typing Booth. 
The remainder of the time is devoted to free choice activities. Concepts 
acquired during the structured learning periods are planned to be reinforced 
during play activities. Play activities are recognized as opportunities for 
development of cognitive, affective, as well as psychomotor learning abili- 
ties. All program activities are presented using a bilingual approach. 

Component Objectives . The objectives for the instructional component 
were developed from the first year program objectives and are as follows: 

At the end of the academic year, the student will: 

1. Indicate a significant gain in language ability in English. 
Evidence of achievement will be determined from gain scores of 
the Peabody Picture Vocabulary Test. 
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2. Indic^ate a significant gain in language ability in Spanish. 
Evidence of achievement will be determined from gain scores 
of the Test for Auditory Comprehension of Language - Spanish. 

3. Indicate a significant gain in school readiness in such areas 
to include: listening ability; visual acuity; and recognition 
of similarities, differences, and numerical analogies. Evi- 
dence of achievement will be determined from gain scores of 
the Readiness Test for Disadvantaged Children. 

4. Indicate a significant gain in motor ability. Evidence of 
achievement will be determined from the gain scores of the 
Motor Activity Scale. 

5. Exhibit a positive self-concept and favorable emotional devel- 
opment. Evidence of such behavior will be determined from 
ratings from the Developmental Profiles which involve periodic 
tec^her evaluations in such areas of the affective domain as: 
awareness of self, self-confidence, interpersonal comprehen- 
sion, sensitivity to others, effectiveness, and tolerance. 
Evidence of growth/develooment will be determined from indivi- 
dual profile sheets plotted in terms of direction and rate of 
growth/development. 

Staff Development Component 

This component is viewed as those activities which will enable the 
staff to improve their instructional skills in all areas of instruction 
as used in the instructional component. Such activities can be classi- 
fied as preservice and inservice. Each district included possible 
future teachers in this program from grades 3-6 so they could receive 
training prior to the vertical expansion into those grade levels. 

Objectives . The objectives for preservice and inservice staff 
training were: 

1. To develop a high degree of teacher competency in both 
English and Spanish presentations. 

2. To assess environmental process variables. 

3. To diagnose educational needs of children. 

4. To apply approximate strategies for overcoming language and 
social dificiencies. 

5. To evaluate teacher learning interaction and utilize self- 
corrective techniques. 
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SECTION III 
EVALUATION 



In addition to the on-going internal program evaluation procedures, 
an external program evaluation study was conducted by an independent team. 
This external evaluation focused on the nursery school this year; however, 
some evaluation was conducted as concerns K-2 which is part of the vertical 
expansion of the program and this evaluation pertained to language develop- 
ment in English and Spanish (as measured by the Peabody Test) and school 
readiness (as measured by the Boehm Test), These tests were administered 
by the various classroom teachers and are not considered as part of the 
external evaluation this year. 



The External Evaluator 

The external program evaluation study was conducted by B, E, Askins 
& Associates, Lubbock, Texas, This is an independent consultant and ser- 
vice organization with its direction primarily through various faculty 
members of the College of Education, Texas Tech University. Members of 
the evaluation team consisted of professional people with various spec- 
ializations including: early childhood and elementary education; bilin- 
gual education; and research and evaluation. Names of the evaluation team 
members are listed on the cover of this report. 



Purpose of External Evaluation 

The purpose of this external evaluation study was to collect and pro- 
vide information necessary for decision-making relative to student and 
program progress. Such information was furnished to the program director, 
the LEA, and to the funding agency. 

Major elements of this external evaluation consisted of: 

1. Providing a variety of professional personnel appropriate to 
the evaluation of the program including: personnel to administer 
tests, site-visits, analysis, and report writing. 

2. Obtaining and administering the selected standardized tests in 
accordance with the evaluation design. 

3. Providing the project director with baseline data which could 
be used in program planning and operation. These data were 
mainly the results from the pretesting phase. 
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4. Preparing reports. 



a. An interim report was submitted to the project director 
for the period July 1 - December 31, 1975. 

b. This end-of-year evaluation report. 

5. Disseminating evaluation reports and other information pertaining 
to the evaluation of the program. 



Evaluation Design 

During 1975-^76, the external evaluation focused mainly on the nursery 
school unit of the program. The evaluation design for this year provided 
for evaluating separately each of the program components (instructional, 
staff development, parent involvement, and materials development) in terms 
of the component objectives and collectively in terms of the over-all pro- 
gram objectives. The evaluation design of one component was governed by a 
strict research-evaluation design while it was more appropriate to evaluate 
the other components by descriptive or subjective means. 



Instructional Component 

The evaluation design of this c>? ?s}nent v/as based upon the component 
objectives which pertained to student achievement. The objectives were 
objectively measured with standardized tests using a pre-posttest design. 
A summary description of the objectives and instruments used are as follows: 



Objective 

L Language development in English 

2. Language development in Spanish 

3. School Readiness 

4. Motor Ability 

5. Self Concept and Personality 

Development 



Instrument 

Peabody Picture Vocabulary Test 
(PPVT) 

Test for Auditory Comprehension 

of Language (TACL) 
Readiness Test for Disadvantaged 

Children (RTDC) 
Motor Activity Scale (MAS) 

Developmental Profiles (DP) 



Form A and Form B of the PPVT and RTDC was used as the pretest and 
posttest respectively. The same form of the TACL was used as the pre and 
posttest. The use of the Developmental Profiles is described later. 

A brief non-technical description of each of these instruments is in- 
cluded in Appendix A. 
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Procedure for Collecting Data > Data to evaluate objectives 1-4 was 
collected with the use of standardized tests within the framework of a 
quasi-experimental design commonly referred to as a "Time Design" or 
"Pretest-Posttest Design Only." This design involves a single experimental 
group without a control group (16). The subject group (the 3- and 4-year- 
old children) was measured on a dependent variable (the pretest), and was 
then given the experimental treatment (instructional activities). Following 
the treatment, the subject group was measured again on the same variable 
(posttest), and a statistical comparison was made between the means of the 
two measurements. Data to evaluate objective 5 was collected with the use 
of the Developmental Profiles. This instrument was completed for each stu- 
dent three times during the year by both of the classroom teachers. 

Time-Schedule for Collecting Data . Pretests were administered Septem- 
ber 2-5, 1975, and the posttests were administered May 10-14, 1976. The 
Developmental Profiles were completed during October, February, and May. 

Statistical Treatment of Data . As concerns the collected data from 
the standardized tests, a mean gain score v;as computed for each test (post- 
test score minus pretest score) by age and year in program. Also, compara- 
tive data were reported concerning the first-year and seccnd-year students. 
The -t-test was used to test for significance of difference between the mean 
gain scores. As concerns the Developmental Profiles, the mean was computed 
for each child for each marking period and was "plotted" on a standardized 
scale to indicate direction and rate of growth/change. 

Reporting of Baseline Data . The pretesting phase was completed during 
September, 1975. Individual test data (raw scores, percentiles, chronolo- 
gical age, and mental age) v/ere provided to the project director on October 
10, 1975. The reason for providing individual test data was to provide 
baseline data which could be used in the program planning and operation. 

Staff Development Component 

This component was subjectively evaluated based upon the previously 
stated component objectives. The attainment of these objectives by the 
staff was determined by observation at various intervals, discussion with 
the staff, and the findings and conclusions are reported in narrative form. 

Evaluation of this component was conducted on a consultancy basis, and 
the consultant was obtained and reimbursed by the evaluator. 

Parental Involvement Component 

This component was subjectively evaluated based upon the component 
objectives. The attainment of these objectives was determined by observa- 
tions, visitations, and review of the records, and the findings and conclu- 
sions are reported in narrative form. 
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Evaluation of the component was conducted on a consultancy basis, and 
the consultant was obtained and reimbursed by the evaluator. 

Materials Development Component 

This component was subjectively evaluated. The developed materials 
were evaluated by observations, discussions with staff, children and 
parents. Findings and conclusions are described in narrative form. 

The evaluation of the component was conducted on a consultancy basis, 
and the consultant v/as obtained and reimbursed by the evaluator. 
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SECTION IV 

EVALUATION DATA OF THE INSTRUCTIONAL COMPONENT 



Summary of Evaluation Design 



The basis for the evaluation design for this component was the specific 
program objectives as stated in Section II. Data to evaluate the objectives 
were collected with the use of standardized tests within the framework of a 
quasi-experimental des-Jgn commonly referred to as a '^Pretest-Posttest Design 
Only" (16). This design involved a single experimental group without a control 
group. The experimental group (the students) were measured on a dependent 
variable (pretest) and was given the experimental treatment (instructional 
activities). Following this treatment, the group was measured again on the 
same variable (posttest) and statistical analysis was made between the means 
of the tv;o measurements. 



A surranary of the objectives/abilities and list of tests used are as 
follows: 



Objectives/Abil ities 



Test 



Language development in English 
Language development in Spanish 
School readiness 
Motor Ability 

Self concept and personality 
development 



Peabody Picture Vocabulary Test 
(PPVT) 

Test for Auditory Comprehension 
of Language - Spanish (TACL) 

Readiness Test for Disadvantaged 
Children (RTDC) 

Motor Activity Scale (MAS) 

Developmental Profiles (DP) 



The "Pretest-Posttest Design" did not apply to the Developmental Pro- 
files. This instrument was completed three times during the year for each 
child by both of the classroom teachers. 

A mean gain score v/as completed for each test (posttest minus pretest). 
The t^"test was used to test for significance of difference between the gain 
scores. Significance was determined at the .05 level or better. Also, an- 
alysis of the test data was conducted by age of the students and by site. 
As concerns the Developmental Profiles, the mean of each student was com- 
pleted for each marking period and was plotted on a standardized scale to 
show direction and rate of change. 
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Number of Students Tested 

Clovis Site 

There were 41 students pretested (100%), and 38 students were posttested 
(95%). There were 31 students who were available for both pre and posttesting 
The reason for N=31 was because of the various withdrawals and new entries 
during the year. 

Portal es Site 

There were 39 students pretested (98%), and 35 students weru^ posttested 
(98%). There were 30 students who were available for both pre and posttesting 
The reason for N=30 was because of the various withdrawals and new entries 
during the year. 



Findings 

The analysis of data for the instructional component is presented in 
terms of the component objectives. 

Language Development in English 

As indicated in Table 1, total students participating in the program 
made significant gains in language development in English. Data are also 
presented in Tables 2, 3, 4, and 5 relating to performance by site and by 
age. 

Language Development in Spanish 

As indicated in Table 1, total students participating in the program 
made significant gains in language ability in Spanish. Tables 2, 3, 4> and 
5 present an analysis of performance by site and by age. 

School Readiness 

A5 indicated in Table 1, total students participating in the program 
made significant gains in school readiness. When analyzed by site, students 
participating in the program at the Clovis site failed to make significant 
gains. Data by site and. age are presented in Tables 2, 3, 4, and 5. 

Motor Ability 

As indicated In Table 1, total students participating in the program 
made significant gains in motor ability. Tables 2, 3, 4, and 5 present an 
analysis of performance by site and by age. 
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Self-Concept and Personal Development 

As indicated in Figure 1, students participating in the program made 
positive and continuous growth in self -concept and personal development. 



TABLE I 



PRE AND. POSTTEST PERFORMANCE OF ALL STUDENTS 
PARTICIPATING IN THE PROGRAM 



TEST 


N 


MEANS 


MEAN 
GAIN 


s 


t 


PPVT 

(ENGLISH) 


62 


PRE 
POST 


23.75 
51.45 


27.70 


14.89 
16.32 


4.82* 


TACL 

(SPANISH) 


62 


PRE 
POST 


15.47 
40.62 


25.15 


14.13 
-22.06 


4.60* 


RTDC 

(READINESS) 


62 


PRE 
POST 


16.45 
29.02 


12.57 


10.83 
10.15 


2.81** 


MOTOR ACTIVITY 
(MOTOR ABILITY) 


46 


PRE 
POST 


7.92 
12.86 


4.94 


2.53 
2.41 


2.86** 



*{p <.001) 
**(p<. 01) 
***(p<. 05) 
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TABLE 2 



PRE AND POSTTEST PERFORMANCE OF 
STUDENTS AT THE CLOVIS SITE 





TEST 


N 


MEANS 


MEAN 
GAIN 


s 




t 


PPVT 

(ENGLISH) 


31 


PRE 
POST 


28.30 
54.20 


25.90 


14.23 
12.41 


4 


.01* 


TACL 

(SPANISH) 


31 


PRE 
POST 


15.86 
40.00 


24.14 


11.65 
16.15 


3, 


.96** 


RTDC 

(READINESS) 


31 


PRE 
POST 


20.72 
30.33 


9.61 


11.97 
10.27 


1, 


,14 N.S. 


MOTOR ACTIVITY 
(MOTOR ABILITY) 


28 


PRE 
POST 


7.76 
15.41 


8.00 


4.43 
4.18 


1. 





*fp<.001) 
**(p<. 01) 
***(p< . 05) 



TABLE 3 

PRE AND POSTTEST PERFORMANCE OF 
STUDENTS AT THE PORTALES SITE 



TEST 


N 


MEANS 


MEAN 
GAIN 


s 




t 


PPVT 

(ENGLISH) 


30 


PRE 
POST 


21.40 
50.31 


28.91 


10.18 
12.41 


5, 


.01* 


TACL 

(SPANISH) 


30 


PRE 
POST 


20.10 
50.53 


30.43 


16.36 
17.10 


5, 


,23* 


RTDC 

(READINESS) 


30 


PRE 
POST 


12.42 
26.46 


14.04 


11.40 
11.13 


2. 


51*** 


MOTOR ACTIVITY 
(MOTOR ABILITY) 


18 


PRE 
POST 


7.77 
13.81 


6.04 


2.53 
2.86 


2. 


02*** 



*(p< .001) 
**(p< . 01) 
***(p< . 05) 
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TABLE 4 

AGE AND TEST PERFORMANCE - CLOVIS SITE 







MEAN 


TEST 


AGE 


GAIN 


PPVT 


•> 


28.41 


(ENGLISH) 


4 


23.16 


TACL 


3 


29.41 


(SPANISH) 


4 


1 0 . DO 


RTDC 


3 


15.00 


(READINESS) 


4 


5.36 


MOTOR ACTIVITY 


3 


5.41 


(MOTOR ABILITY 


4 


10.00 




TABLE 5 




AGE AND TEST PERFORMANCE - 


PORTAL ES SITE 






rILMI'i 


TEST 


AGE 


GAIN 


PPVT 


3 


31.16 


(ENGLISH) 


4 


24.20 


TACL 


3 


36.00 


(SPANISH) 


4 


27.03 


RTDC 


3 


13.82 


(READINESS) 


4 


6.41 


MOTOR ACTIVITY 


3 


6.32 


(MOTOR ABILITY) 


4 


10.10 
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FIGURE 1 - GRAPHIC SUMMARY OF PERSONAL DEVELOPMENT 
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SECTION V 

EVALUATION DATA OF THE OTHER COMPONENTS 



In addition to the instructional component, the program consisted of 
three other support components. These components were the: staff develop- 
ment component; materials development component; and the parental involve- 
ment and home education component. Each one of these components had 
specific objectives (Section II), and the components were subjectively 
evaluated based upon the stated objectives. 

Staff Development Component 

This component consisted of various activities designed to assist the 
staff to improve their instructional skills as required in the instructional 
component. Such activities could be classified as preservice and inservice. 
Each school district included future teachers of grades 3-6 in this staff 
development training so they could receive training prior to the vertical 
expansion of the bilingual program into those grade levels. 

Preservice Activities 

Preservice training was provided to the faculty/staff prior to the be- 
ginning of the school year. This training was primarily in the form of two 
workshops in coordination with Eastern New Mexico University. The partici- 
pants could receive semester hours credit, graduate or undergraduate, which 
could be applied to degree requirements and/or certification leading to a 
degree in bilingual education. 

The first workshop. Workshop on Implementation Procedures on Early 
Prevention of School Failure, was conducted at Eastern New Mexico State 
University, May 28-30, 1975. This workshop was conducted by a dissemination 
team from the Early Prevention of School Failure Program, a nationally vali- 
dated ESEA Title III project, located in Peotone, Illinois. 

The second workshop. Early Childhood Bil ingual/Bicul tural Education; 
Why and How, was conducted at Eastern New Mexico State University, August 
18-20, 1975. This v/orkshop was conducted by three faculty members of the 
Metropolitan State College, Denver, Colorado. 

Both of these workshops were evaluated using the McCal Ion Workshop 
Evaluation System. Each of the workshops was evaluated by the participants 
as being very well conducted and extremely beneficial. 
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Inservice Activities 

Various types of inservice activities were provided for the teachers 
and aides which included: enrollment of designated graduate/undergraduate 
courses at Eastern New Mexico University; formal and informal sessions with 
various consultants, including members of the external evaluation team; 
attending various training institutes; and working closely with the REEEP 
outreach training team which included the Mobile Resource Learning Center 
(mobile van) and various types of professional personnel (early childhood 
specialists, educational diagnostician, language specialist, and speech 
therapist). Some of these activities are described in the following para- 
graphs. 

The two college level courses conducted by ENMU which were specially 
designed and arranged for faculty/staff of the bilingual education programs 
in Clovis and Portales were: "Spang-lish" which had 22 participants; and 
"An Introduction to American General Phonetics" with 15 participants. Each 
participant received a stipend of $200 per course which was provided by the 
Title VII training funds. Also, c credit could be received for degree/ 

certification from ENMU for satisfactu completion of the course "Concept 
Development in Early Childhood" which Wa5 conducted by the REEEP training 
team during the year. 

The Bilingual Resource Center of the University of New Mexico greatly 
assisted in the staff development component throughout the year with their 
cooperation in providing technical assistance and conducting several train- 
ing sessions pertaining to bilingual education. Also, the Bilingual Re- 
source Center provided funds for the project director to attend the Inter- 
national Bilingual/Bicultural Conference in San Antonio in May, 1976. The 
Resource Center also sponsored an institute concerning "Assessment and 
Evaluation of Minority Group Children" at New Mexico State University, 
May, 1976. One teacher (Paz Martinez), with stipend of $400, was selected 
from the Clovis-Portales area to participate in the institute. The Center 
sponsored "A Bilingual/Bicultural Workshop for Administrators/Counselors", 
which was conducted at the University of Texas at El Paso (June 14-July 2, 
1976), which was attended by the project director. 

The faculty/staff attended several sessions concerning Southwest cul- 
ture which were provided through the Bilingual Teacher Training Unit of the 
New Mexico State Department of Education. 

in addition to these formal training activities, the faculty/staff 
attended regularly scheduled faculty meetings. 

Summary 

Considering the component objectives and the quality of the preservice 
and inservice training, it was concluded that the stated objectives of the 
staff development component were achieved. 
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Materials Development Component 

This component was mainly the process of continuing to adapt the 
materials for the progran which were developed in the REEEP (See Section I) 
program for the 3- and 4-year-old children. Most of these materials are 
based upon the research of Jean Piaget as reflected in the Early Childhood 
Curriculum authored by Celia Lavatelli and by use of various curriculum 
materials developed by Media Services and Captioned Films. Other materials 
adapted for use in this program included: Project LIFE (Language Improvement 
to Facilitate Education); the Peabody Language Kits; and the Responsive 
Environment Booth. 

This process of reviewing, adding/adapting bilingual education materials 
for this age group was greatly facilitated by the services of the outreach 
activities component of the REEEP program. This included the services of the 
Mobile Learning Resource Center, a mobile van, which contained an excellent 
assortment of bilingual and early childhood education materials. 

Based on classroom observations and discussions with the teachers, it 
was concluded that this component was progressing in a satisfactory manner. 



Parental Involvement and Home Education Component 

This component was designed to consist of activities and processes to 
assist parents with the understanding and practice of underlying principles 
of child care. The specific objectives of this component are listed in 
Section II. 

During the year, there was limited formal activities of this component. 
According to the project director, limited activities in this area was neces- 
sary due to budget reductions. 

The activities of the component did include: monthly meetings of the 
parental/community advisory group; some parents did get involved in classroom 
activities of the nursery school; and a Christmas and spring parental/commun- 
ity program including Las Posadas and Marachi music program with speakers from 
the Bilingual Teacher Training Unit of the New Mexico State Department of Ed- 
ucation. 

Based on site-visits, observations, and discussions with parents and 
teachers, it was concluded that this component of the program needs to be 
strengthened. 
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SECTION VI 

EVALUATION DATA OF THE VERTICAL EXPANSION OF 
THE BILINGUAL PROGRAM 



The bilingual program is being expanded vertically in the municipal 
schools of Clovis and Portales. The bilingual program operated this year 
in certain sections of grades K-2 at both sites. The data in this section 
pertains to the performance of these students. These students were pre and 
posttested by members of the outreach training team (REEEP), and the test 
data were provided to the evaluator for analysis and inclusion in this re- 
port. 

Abilities Measured and Instruments Used 

The abilities measured and instruments used were: language development 
in English as measured by the Peabody Picture Vocabulary Test - Emglisfi 
version; language development in Spanish as measured by the Peabody Picture 
Vocabulary Test - Spanish version; and basic skills as measured by the 
Boehm test. 

Statistical Treatment of Data 

Progress in each area was determined by the amount of gain accomplished 
between the pre and posttest. These differences were statistically treated 
using the t_-test with significance being determined at the .05 level or 
greater. 

Analysis of Data 

The provided data were analyzed by grade and site. The analysis indica- 
ted a significant gain on each of the three measures for each grade level. 
These data are presented in Table 6. 



28 



22 



TABLE 6 



PERFORMANCE OF STUDENTS IN THE BILINGUAL PROGRAM 
IN GRADES K-2 AT CLOVIS AND PORTALES 



TEST 


SITE 


LEVEL 


MEAN 


GAIN 


s 


t 


PEABODY 


CLOVIS 


K 


27. 


.10 


11.61 


3.86* 






1 

1 


1 

lo . 


• 01 




c , /O 






2 


13, 


.40 


10.64 


2.13** 


PEABODY 


CLOVIS 


K 


21, 


,18 


15.81 


3.11** 


(SPANISH) 




1 


17. 


,41 


14.82 


2.68** 






2 


12. 


,60 


15.40 


2.31** 


PEABODY 


PORTALES 


K 


26, 


,43 


14.08 


3.71** 


(ENGLISH) 




1 


21, 


,22 


12.62 


3.18** 






2 


16, 


40 


15.40 


2.53** 


PEABODY 


PORTALES 


K 


27. 


09 


15.65 


3. '83* 


(SPANISH) 




1 


13. 


71 


16.0~9 


2.34** 






2 


12. 


06 


17.53 


2.26** 


BOEHM 


CLOVIS 


K 


12. 


62 


6.42 


2.33** 




PORTALES 


K 


10. 


41 


10.11 


1.88*** 



*(p .001) 
**(p . 01) 
***(p . 05) 
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SECTION VII 

SUMMARY, FINDINGS, CONCLUSIONS, AND RECOMMENDATIONS 



Summary 

The purpose of the program, A School and Home-Based Bilingual Education 
Model, was to develop, over a five year period, a model bilingual program 
from nursery school (beginning at age 3) through grade six. This model 
program is a cooperative effort among the Clovis Municipal Schools, Portales 
Municipal Schools, and the U.S. Office of Education (ESEA, Title VII). 

The evaluation design for 1975-76 focused mainly on the nursery scnool 
unit of the program which serves 3- and 4-year-old children at each of the 
sites in Clovis and Portales. 

Findings 

The major findings of this evaluation study were: 

1. Students participating in the program made significant gains in: 
language development in English; language development in Spanish; school 
readiness; and motor ability. 

2. When the test data were analyzed by age of the students, both the 

3- and 4-year-old age groups made significant gains in the four areas measured. 

3. When the test data were analyzed by site, there were no appreciable 
difference in perfonnance except students in the program at the Clovis site 
failed to make significant gains in the area of school readiness. 

4. Students participating in the program showed a positive and con- 
tinuous growth in self-concept and personal development. 

5. The students in the program were found to be extremely friendly 
and cooperative, willing to try various tasks without fear of failure, 
and an unusually long attention span for this age of children. 

6. The staff development component provided excellent preservice 
and inservice training activities for the faculty and staff. 

7. The parental involvement component provided for only a limited 
number of activities. Little home-visiting was evident. 

8. The materials development component was in an active process of 
selecting and adapting bilingual and early childhood education materials 
for the program. 
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9. Students in the bilingual program in grades K-2 made* significant 
gains in: language development in English; language development in Spanish; 
and school readiness. 

Conclusions 

Based upon the findings of this study, the major conclusions were: 

1. The instructional component functioned effectively as evidenced 
by all of the component objectives being achieved. 

2. The staff development component was effective as evidenced by 
all of the component objectives being achieved. 

3. The materials development component is doing a satisfactory job 
in selecting and adapting instructional materials for the program. 

4. The parental involvement component did not achieve all of the 
stated objectives. 

5. The program is in an active and positive process of accomplishing 
the long range major goals. 

6. In short, the program has the organization, curriculum, materials, 
and a dedicated faculty/staff to provide the needed educational experiences 
for the target children and to serve as a model program; therefore, it was 
concluded that the program functioned as planned in accordance with the 
approved proposal during the 1975-76 school year. 

Recommendations 

Based upon the findings and conclusions of this study, the following 
suggestions or recommendations were made: 

1. That this program continue the replication and the inter-relationshi 
with the Responsive Environment Early Education Program (REEEP). This 
joint cooperation/operation of the two programs seems to be feasible, both 
operationally and economically. 

2. That the parental involvement component be strengthened. 

3. That the program continue to develop amd serve as a bilingual and 
early childhood intervention and model program. 
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APPENDIX A 



DESCRIPTION OF INSTRUMENTS 



A brief non-technical description of each of the test instruments 
is listed in the following paragraphs. Personnel interested in more detail 
concerning the tests are invited to consult technical data provided by the 
publishers of the tests or refer to the Mental Measurements Yearbook, 
Buros, editor. 



Language Development 

English 

The Peabody Picture Vocabulary Test (Dunn) is designed to provide 
an estimate of a subject's "verbal intelligence" through measuring his 
hearing vocabulary. The test also has wide utility as a clinical tool. 
Besides being effective with average subjects, it has special value with 
certain other groups. Since subjects are not required to read and the 
responses can be non-oral, the test is especially fair to non-readers and 
remedial reading cases. With the drawings free of fine detail and figure- 
ground problems, the test is apparently appropriate for at least some 
perceptually impaired persons. According to the Test Manual , the scale is 
appropriate for subjects - 18 years who are able to hear words, see the 
drawings, and have the facility to indicate "yes" and "no" in a manner 
which communicates. 

This standardized test is published by American Guidance Services, 
Inc., Circle Pines, Minnesota. 

Spanish 

The Test for Auditory Comprehension of Language (Carrow) measures the 
child's understanding of the Spanish language structure. The test is com- 
posed of 101 plates of pictorial referents. The child responds to each of 
the examiner's oral stimuli by pointing to one of three line drawings. Re- 
sponses are recorded on a separate scoring/analysis form. The test is 
designed for individual administration by speech and testing specialists. 
Test results can also be used to diagnose the language competence of bilin- 
gual and mentally retarded children as well as those with hearing, articula- 
tion, or language disorders. 

This standardized test is published by Learning Concepts, Inc., 
Austin, Texas. 



School Readiness 



The Readiness Test for Disadvantaged Pre-School Children (Walker) 
was adapted from the final report of a project conducted by Dr. Wanda 



Walker, Northwest Missouri State College, and supported by the Office of 
Education. The test consists of multiple-choice items based on pictures 
and symbols which do not require reading ability and are designed to test 
a child*s listening ability; visual ability; and his recognition of simi- 
larities, differences, numerical analogies, and missing parts. 

This standardized test is available from ERIC Reproduction Service 
(ED 047 168), Bethesda, Maryland. 



Self Concept and Personality Development 

The Developmental Profiles (Bessell and Palomares) is a subjective 
evaluation of children's behavior under a variety of circumstances. 
These rating scales are prepared periodically jointly by two teachers. 
The teachers make ratings on a printed form according to six affective 
areas: awareness of self; self-confidence; interpersonal comprehension; 
sensitivity to others; effectiveness; and tolerance. Because of the in- 
herently subjective nature of these profiles, there is no objective scale 
of accomplishment or standard in terms of age-achievement scores. The 
profiles can provide a source of insight and understanding of emotional 
and personality development. 

This instrument is published by the Human Development Training Insti- 
tute, El Cajon, California. 



Workshop Evaluation 

The Workshop Evaluation System (McCallon) provides a scientific ap- 
proach to gathering and using participant feedback in the evaluation of 
conferences, workshops, conventions, and in-service training programs. 

Participant responses are gathered on seven dimensions - organization, 
objective, work of the presenter, ideas and activities, scope, benefit, 
and overall effectiveness. The Workshop Evaluation System is unique in that 
it provides normative data collected from over 40,000 workshop participants. 
Participant feedback scores are compared against the norms to ensure reli- 
able analysis and interpretation of workshop effectiveness. 

This instrument is published by Learning Concepts, Inc., Austin, Texas. 
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